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ABSTRACT . 

Questionnaire and interview methods are described as 
reactive because when these methods are used, the participant's 
reactions to the research process may influene his or her responses. 
Nonreactive methodology refers to unobtrusive methods of collecting 
data in which participant reaction to the process of data collection 
does not interfere with the response. Nonreactive methods of data 
collection have been used in other fields, and the student affairs 
professional can improve research techniques and implement a 
multi-method assessment strategy by incorporating nonreactive methods 
into current research programs. In the past, student affairs 
researchers have employed nonreactive methodology in examining the 
success of an assertiveness training program (McFall and Marston, 

1970) , police bias in monitoring traffic violations (Heussenstamm, 

1971) , and a noncognitive predictor of student success (Sedlacek et 
al., 1984). Attempts have been made to create a classification system 
of nonreactive methodology. Webb et al. used the categories of 
physical traces, archives, and observation to describe various types 
of nonreactive data. Sechrest and Phillips proposed a matrix as a 
step toward a taxonomy of nonreactive methodology. By taking steps to 
employ nonreactive techniques, student affairs professionals may find 
this methodology a useful addition to their work. (NB) 
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Summary 

Relying exclusively on questionnaire and interview data can 
cause the student affairs researcher to overlook nonreactive 
methodology: unobtrusive methods of collecting data in which 
participant reaction to the process of data collection does 
not interfere with the response. Such methods of data 
collection have been used in other fields, and the student 
affairs professional can improve research techniques and 
implement a mu 1 1 i-me t hod • assessmen t strategy by incorporating 
nonreactive methods into -current research programs- Examples 
in which nonreactive methodology has been used in student 
affairs research are discussed'; «nd practical steps are 
presented to help in beginning a program of nonreactive 
research. 
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Nonreactive Measures in £; Affairs Research 

Many student affairs profass \s encounter 

dif f Acuities in conducting res© a re uch as lack of time 
funding, or confidence, which can le<ic them to avoid research 
efforts altogether (Brown, 1986; He • d , Kerr, Biggers & 
Elliott, 1986). However, "if we arr to survive through the 
next century... it is imperative thc^ we support ressarch and 
evaluation that examine?* our service': and programs and what 
impact they have on students" (Brown, p. 195). Methodology 
can pose particular problems. Those beginning a research 
effort may find that the first data collection methods which 
come to mind invo ive quest ionnaires or interviews. Certain 
inherent difficulties with these methods are obvious, such as 
the time consuming nature of constructing and scoring 
ques ienna i res and/or conduct ing interviews, or the expense 
involved in printing costs and supplies. 

Another problem with interview and questionnaire 
methods that is often overlooked has been noted by Webb, 
Campbell, Schwartz, Sechrest , and Grove (1981). They 
describe such methods as "reactive" because when these 
methods are used, the participant's reaction to the process 
influences his or her responses. This is a serious problem 
because when people know that they're being observed or that 
their responses are being, counted in some way, they do not 
always respond accurately or honestly. An example relevant 
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to student affairs work might be one in which researchers are 
interested in exam in ing the, degree o f rac ial discrimination 
present in a college sports program. To answer their 
quest ions , they interview coaches and ath let es about the 
a 1 leged prob iem and administer various rac ial attitude 
questionnaires. However, given the demand characteristics of 
the situation (coaches - the des i re t ,ir, . the i r programs t o 
appear in a positve light; athletes - the pressure no% to 
jeopard ize th© i r ath let ic careers) , the racial problems are 
minimized, and, receiving these results, the administration 
continues current policies when more accurate information 
would have suggested changes. 
Nonreac t'ive Methodolog y 

In response to such a problem, student affairs 
professionals can employ nonreact ive methodology : 
unobtrusive methods of collecting data that do not interfere 
with the response * i tse 1 f <Ulebb et al., 1981). In the 
previous example of racial discrimination in a college 
athletic program, one simple nonreact ive approach might be to 
use team records to review the racial make-up of past teams. 
Do any pat terns emerge with respect to what positions are 
played by minorities? Have minority players ever., 
consistently assumed leadership roles such as quarterback? 
(See McGehee & Paul, 1984). This method involves minimal 
effort and is nonreactive. 
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At this poi^t, the reader may be struck by the obvious 
nature of the nonreactive method just described. It is not 
a difficult approach; most people collect information 
nonreact i ve ly every day, but are simply not aware that they 
are accummu lating potentially useful information. 
Examples in Student Affairs 

In the past, student affairs professionals have 
occasionally employed nonreact ive methodology, resulting in 
innovative research designs. To assess the success 
of an assert iveness training program, McFall and Marston 
(1970) posed as magazine salespersons and telephoned former 
program participants in order to unobtrusively analyze 
their assert iveness . In a nonreactive approach to 
questions about police bias in monitoring traffic 
violations, Heussenstamm (1971) had student research 
associates with unblemished driving records put Black 
Panther bumper stickers on their cars. Results indicated 
that this group received more traffic tickets than did a 
control group, supporting the hypothesis that the police 
discriminated against this group when issuing traffic 
citations. In order to identify a noncognitive predictor 
of student success (other than, for example, SAT scores) 
Sedlacek, Bailey and Stovall (1984) analyzed types of 
errors made by prospect ive students in completing freshman 
orientation applications. Those who folio wed directions were 
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more likely to stay in school. In a symposium presented at 
the University of Mary land, severe 1 add i t i one 1 ideas were 
presented and discussed (Abler, Bandalos, Boyer, Sedlacek, 
Sargent, Thomas & Thompson, 1986). Observers went to target 
locations in the student union to count the number of 
students present during random time slots. Frequencies of 
handouts taken from a commuter' affairs office were used to 
determine program needs* Conference presentations were 
evaluated by observing audience seating patterns and 
participation rates. In a discussion of implications for 
future research on counseling center retention programs, 
Weiss and Giddan (1986) report on recent nonreactive studies 
which use archival data to assess the relationship between 
counseling center programs and student attrition. 
Classifying Nonreacti v e Studies 

Given the variety of nonreactive research being 
conducted, attempts have been mafJe to create a classification 
system of nonreactive methodology. Webb, Campbell, Schwartz 
and Sechrest (1966) used the categories of phy* ica 1 t rqces 
(such as the errors left on orientation applications used by 
Sedlacek, Bailey and Stovall, 1984), archives (such as the 
team records used by McGehee and Paul, 1984) and observat io n 
(such as the student un-ion and audience seating observations 
described above) to describe the various types of nonreactive 
data. Sechrest and Phillips (1979) note that this system was 
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"ad hoc and soley for the sake of convenience in 
wr i t ing . . . not carefully thought out as a conceptual 
framework" (p. 9). In an alternative approach, they proposed 
a matrix as a step toward a taxonomy of nonreactive 
methodology. One axis of the mal^x consists of a li:;': sF 
poss ible purposes of assessment (for example, to determine 
interest, category membership, or affective state); the other 
axis consists of non react ive character istics of the responses 
to be observed (such as frequency or magnitude). The first 
axis is used to categorize the research question. The second 
axis provides a variety of ways to operat iona 1 ize the 
research quest ion using non react ive data. Table 1 
illustrates an application of this matrix using a student 
affairs example. 



Insert Table 1 about here 

Advantages and Disadvantages 

As with any research methodology, advantages and 
disadvantages exist for the student affairs researcher 
emp loy ing non react ive techn iques . Advantages , as previous ly 
discussed, include the low cost and less extens ive- efforts 
requ i red and , most important, that participant reactions to 
the data collection procedures cannot bias their responses, 
Ethical considerations bring up a potential d i sad van t age in 
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nonroac t i ve research: is privacy and the right to informed 
consent violated when participants are not aware of the data 
collection procedures? Such questions can only be answered 
on an individual basis, the circumstances involved in c:.:::': 
research en t e rp r ise be i ng un ique . Another potential 
disadvantage is that there is no guarantee that the data 
which the researcher has nonreaictively collected actually 
represent the construct of interest. The solution to,, such a 
problem leads to the conclusion drawn by Webb et al. (1981): 
namely, that nonreact ive methods are not meant to replace th< 
traditional questionnaires and interviews but rather to 
supplement and cross- va 1 idate them- In this way, a multi- 
method research program as advocated by Campbell and Fiske 
(1959) can be implemented. 
S-teps in Doing Nonreact ive Research 

Fi rst j. bring up the idea of nonreactive research at a 
staff meeting. Review your current data collection 
procedures and then brainstorm as to how to nonreact ive ly 
collect the information you need. Second , when planning 
programs, ask yourself the question, M How can I tell how we 1 
I'm doing without asking the recipients of this service? 11 
Whatever nonreact ive procedures you implement can be cross- 
validated against the paper-and-pencil evaluation forms 
normally used. Th i rd , use the "critical incident" technique 
(Flannagan, 1954) in your daily work and think nonreact ive ly 
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in order to develop ideas. In this approach, direct 
observations of human behavior (critical incidents) arc- •-od 
as a springboard for solving practical problems. The 
incident may be an outstandingly positive or negative o «:•..«?. i a 
of the issue to be studied. For example, the Sedlacek et a l. 
(1984) study of application errors and student success 
developed out of a critical incident: an obviously lost 
student wandered into a staff meeting (the critical incident) 
which began a staff discussion of how to better predict 
successful students and eventually led to the nonreactive 
study then conducted. Student affairs professionals who take 
steps such as those described above and employ nonreactive 
techniques may find this methodology a useful addition to 
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Table 1 

r^lyincL Q,.. Stude nt Aff airs Example to Seen rest & Philli ps' (.1979) 
Illustrative Matri x for a Gene rati ve Taxonomy of Non reactive Measu res 



(EXAMPLE) 

Research Quest ion s Are un ivers i ty students interested in 

additional campus computer terminals? 
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